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i NTRODUCTION 

4 * 
' * * • * • 

"Plannitig-Evalua-cLon in the Medium Size School Distrj,ct" is a 
worki^ig document which^ has been submitted to the management of the 
Duluth Public Schools as a base for developing an ogeratiorial system 
of planning and evaluation. The conceptualization is founded on. 
several observations by the author, which- are presented in this 
introduction as theory-. The assumptions of the theory are: 

!• In all pha'Ses of school system planning and v 
evaluacion the individual student is the unit 



of analysis. 

I ■« • 

2. Student-teacher j.nterac'tion is the primary 

function of the school, system* 

3. All tasks and process/es of a sch6ol system 
can be* defined dn relation to the individual 
student's behavior resulting from student- 
teacher interaction* 

4. The process of. .planning and evaluation should 
initiate and terminate with the individual 
student* / 

5. Between initara-fcion and ^termination the? process 
of planning and evaluati on pruvi des 'i nTotmatiop 

. to several ^deri 5^1 ou makers separated hy ^various 



degrees of time, physical location and aware- 
ness from the point of student-teacher int^r- 
action. 

The' greater the^ degree of separation between the 
. decision maker and the point of student- teacher: 
interactibn, • ' 

. ' . V * 

I 

(a) -the greater are the number of 

students and"^ points of student- 

Izeacher interactions considered in " ^ . 

the informatibn base for decision-making, 

and 

(b) the more general -are the statements 
of expectations^^,£er students and 
student-teacher interaction. 

The 'degree of specificity required in an information ^ 

base for -decision-making is not related. to the degree 

• of c^separation between the decision maker and the 

* * • 

point of student- teacher interaction. Rather, the 
degree "of specificity is relafted to the effective- 
ness and efficiency of the decision. 
The" effectiveness and efficiency of a decision- 
making process is determined by three criteria: 



'^(a) The satisfaction of student needs resulting ,' 

■ • ■ , ' 

from maintenance or change in student-.^, ' 

' teacher interaction, ' , 

(b) The tim<t lag between the identification of' 
student need and- the satisfaction of student 

(c) .The cost in- "human ^and material- resources; . 
-for mai'ntaining or changing student-teacher 

interaction. 

Acceptance of the theory leads to several conclusions pertaining, to 
a planning -and evaluation process:. ' . 

' 1. The definition 6f a planning and evaluation, process shoulo 
be initiated with, the individual student and the indi- 
vidual point of student- teacher interaction. 

2. At each level of decision making, the data* base 

. and resulting information base. should4e expanded 
to include all, students and points of student- 
teacher interaction affected by the- decision. 

3, Decisions at a given point of separation from a 
' 'point of student- teacher awteract'ion should be 

preceded by decisions at points of decision 
making in greater ■ proximity to the point Cf 
student-teacher interaction. • 

' - . " (iii) 



< 



\ 



4* The creation of the data and inforrrction base' 
'should be an accumulative . function following 
an unbroken chain of 'communications consistent 

' in content and degree ^ of specif icity* ^ I 

}- \ ^ ^ 

At present, planning, and evaluation models tend" to emerge at an 
organization 'level between top management and the field adminis- 
trators. The models are primarily designed to provide, middle - 

e 

and top management with an 'information base. At best, these models 
reach down 'to the level of teachers using the managemfint-by-objectxves 
,concept as a planning and ^control mechanism. In mo&t instances the* 
objectives are sit by administrators -ahd teachers for themselves 
without being preceded by a student needs assessment. .In this 
situation the managem*fent structure tends to hover above the student „ 
and the point of ' student-teacher interaction, with an occassional 
and somewhat* random connection* 

The dysfunction resulting from initiating h planning and evalua- 

✓ 

tion process' at a location other than' a point of stiident-teacher 
interaction, is often obviated at' the federal level by: guidelines- 
for w)iich school districts cannot identify data-based needs; evalua- 
tions designed to' measure objectives different from those of the _ 
local districts; and discrepancies in role definitions for 
federally funded local school staff and' the tasks these staff -, 
members 'perform. 

The state departments of education administering the programs ^ 
add an additional set of decisions . several steps removed from the 

(iv) ' • • 



point of ^student^ teacher interaction, which 'in turn are filtered; 

o 

:hrough the- central administration of a local school districti 
hrough the central administration of a local school district, 
anbther -set of decisions is superimposed on the point of student- 
teaser interaction. 

Considbring the local district planning and evaluation process 

independent of federal funding, the dysfunction is much the same. 

\ ° ' • ■ L - " • 

system £pr planning and evaluation is developed somewhere in 

middle -management or purchased from an educational management ; 
corporation.' fhe 'structure is then ^ilore^d to accommodate pro- 
gram titles usually correlated with cS^ntral administrative positions 
presently in existence. A set of forms i,s then sent to the schools 
for the principal to complete\ -in -which the line item budget is 
"divided among programN titles. Teachers, principals and ce'ntral ^ 
office administrators gene);ate objectives particular to their role, 
usually in the context of task performance. These objectives, - 
combined with the/program budget, are then presented as a systems 
approach to school managemeni;, i. e. , the resultant product of a 
planning process. 

The general framework for. the planning and evaluation process 
presented in this paper is based on the premise th^t individual 
student needs must be identified and performance objectives 
generatecl* before other steps, in the planning process, can be 
initiated. Two ioasic companion system^ are proposed, - The first 
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describes goal --setting stir.uc tare and the second describes the 
maniagement component for implementing the systemo The paper does 
not contain . extensive descriptions on documentation of software 
used to implement th'e system. / These materials are being prepared 

under separate covero v ^ ' * / ' / / 

<«. , ^ 

A feasibility study testing the mechanics of the goal structure 
is presently being attempted in the area of word attack skills 
bas.^;d"on the Wisconsin Design for Reading Skill Development and 
a jComputer Manager' In s true tior^v System developed by the Duluth 
Publit J Schools in' conjundtion with the Research and Development 
Center for Cognitive Learning of the University of Wisconsin. 
In brief review, the program .requires the teacher to administer 
a baseline test and, after reviewing the pre-test' score of each ^ 
student and the past performance of "the Student, the teacher gener- 
ates levels of expectation for each student in terms of their anti.- 
cipated progress (niindDer fef skills to be mas;^$:er'ed) . Based on a 
.simple accumulative ^function, levels of expectation are then 
generated for the classroom, the grade level within the school, and 
the grade level within the districto ' It is anticipated that the 
system will be expanded within the next school year to oth^^r 
elements of the Wisconsin Design and to a math program and skills . 
list developed by the Duluth Public Schools. 

In those areas for which hard data measures aire not available, 

V 

perception instruments have been used to obtain student baseline 
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information and individual student expectations. A system is 
also being developed to quantify individual student "objectives for 
supportive services, such ^ as-; social work, psychologists, speech" 
therapy, ettcjl ^\ ^ " . • 

■ i ''\ ' ' ' . ' 

Implementation for the^management compc5nent of the Planning- 
EvaluatiQPi System is being deyelq^i'^f ih the context of- federal 
\programs^( most specifically. Title 1. Although some setbacks have 
been experienced, the basic elements of the management model have 
been "initiated "acid the' documentation for role definitions, task, 
p^rfoj/mance, thfe, managementvof eacU^-^ebr.ponent prc/cess, resultant - 



products from, each compopgfi€7 "and the sequence of project feedback 
have keen ^completed and -a report, on the first year '^effort is ncjw 



sche(^uled for August of 1973. A second year of implementation 
will center on tasjc analysis in relation to the objectives. The 
attempt will be to quantify the specific tasks which lead to the 

9 

attainment Of the student objectives so as to. allow for analysis 
in conjunction with the budget allocations. The basic approach 
presented in The Milwaukee Approach to Cost/Ef f ectiveness V will be^ 
employed* 



♦ Crist H. Costa, Roger Mo .Giroux and Roy Pedprson: The Milwaukee 
Approach to Cost/Effectiveness , Asso<-i nf-i on of ScUool Business 
Officials* 1971. 

(vii) 



"^-^ ■ , • statement of "the Problem 

■ _ " .Rationale fpr Planning-E valuation 

The problem facing ah educational decision maker, is one of having 
to, choose among alternative cdurses of action -which have not been 
quantified and,, .in';tK>st instances, have not been sufficiently 
defined or identified. -Tne problem, is usually chai^actferized by , 

the definition of goals and processes in^ terms which fail to '.*, 

~ ■ ^ • " • ■ • ' 

commvinicate *he specific irifprmai^ion needed to discriminate between 

alternatives. A partial soautibn to the problem, and a needed base 

for evaluation, i^ 'the definition of goal,s in terms of specific and 

measurable objectives and the definition of processes in terms of 

tasks which consxime human and material resources and are scheduled 

'to take place vdthin a, set period of time* 

- , , , 

For example, 'the goal of one project may be ^t<^^ Lmprove the educa- 
tional environment" and the goal of the second project way be "to 
improve the curr iculvmi" . Until these goals are defined in more 
.specif ic terms , the decision maker cannot Be certain of what he is 
considerijng. ' If the' goals are described in term^ of specific 
obserable tasks such as "to purchase. 500 Volumes for the library" 

« 

(i.e., to improve the educational environments or "to introduce a 
course on consumer economics" (i.e<, to improve the curriculum) the 
decision maker is at least able to discriminate between the kinds 
of alternatives open. to him. 

Although these, objectives are defined sufficiently for some decision 
making, they are not sufficiently. defined for consideration of 



r ■ f . 

q^alii:y' of output or cost' of prpdu*ct;ion. For .example^ the 4ec,isfion 

•> .(•'•.-. 

maJcer may consider an addition of SOO volumes to the library desirable 

, ■ ■ . . ^ •■ - . ■ t ' 

if/{l) the voliunes relate to subjects v^ich ar^ in need of sdurce . ^ 

material, (2) they can be obtained in a ten-month period, and (3) the 

total cost is less than five dollars. a volxjmea Th^^decipS-ion maker 

may also consider -the course on cprfsuiher Economics defeirabla. only if 

.(1) the course satisfies' an identified student need, (2) the course 

complements the ^stablishfed curriculum, and (3) ^he course can be- 

initiated at .an Expense of le.sfe than $3if)pO for 'an., academic year-- 

Xf . the decision maker' should' decide to implement either or both of 
the .'proj-ects, he must next be concerned with the alternative means 
of attaining the desire'd out'conWs. It lis at this point in the 
decision-making process that the def:.nition of processes needs to 
be staged in' terms of specific tasks to be performed. The decision 
maker needs' to identify the most efficient and triost effective course 
of action by which to accomplish the objectives. The ^tasks should 
consume minimum resources and yet achieve a desired quali-ty of 
^performance. ' » 

A basic element of the approach to the decisidn-making process, via 
planning .and evaluation, centers on several assumptions. The deci- 
sion maker has identified a- need and the 'satisfactiori of the need 
has been. given a high priority, thus the decision maker has com- 
pleted his choice of the kind of objective to pursue. In addition 
to the choice of objective, .the decision maker has determined a 
level of performance or an expectation for quality. 



At this point the decision maker mpst choose a soIiJ,t£oa whxch - 
ma^gi^be either 'saccesstUl or unsuccessful. ' I£ the solution is' un- 

succes:^rul, he must find another solution- . He^may hot conclude t^at 

• , ' ' * - i- ' ■ « -J 1, 

because the soluti^ori is unsuccessful he ipust eliininat^ th'e" project 

and thus the objective. Th^ decision maimer must ultimately choose 

>etwebn. processes as opposed to projects i ' .J* ^' " , , 

" ' ' "\ ■ / • \' ■ ' V .- " \. 

^If a school has i-^entified-a need Osuch as- high,er studentUchieve- 
\ ■• . , '•: r ' ' • ' "■ > ■ • r " • - 

mentf and initiated ^ solution (.a special reading prograi^r), which 

failed, the decision maker mUst, avtSid eliminating the project in . 

Such a way as to eliminate the objective and thus ignore the need. 

Rather -i:han ask the question of whether the project succeeded or 

failed, he mu^t identify the components of the project which were 

most successful and also those components which were least success- 

ful. In the act of discriminating between levels of su.ccess, he , 

must also consider the^ costs ox the components. These conditions ^ 

of the decision-making 'processes form the need on which the con- 

ceptualization of evaluations-must be basea. 

\ \ ■ ~' ' 

The operational structure of an eciucational system, howeveir, is 

necessarily ill-suited to, a classicfal applica^ Ion- of a research 
designl* The application of classical research presuppoF.as control . 
over the operation of a program. As has usually been the case, 
control, such .^s defined in a clas^cal control/experimental research 
design, is seldom evident in school operations. For example, experi- 
mentation with a new method of teaching, a new textbook, or n^w 
equipment would be introduced to a sample of students from a. defined 



»• 

. 0 



population. The use of "the textboolf would-be controlled and most 

intervening variables, such as class size, facilities, the teacher, 

etc., would^also be variables controlled arxd accounted for. The * 

.achievement scores of" the experimental group of students would then 

r 

be corapaned with the achievement; scores of a sample of students 
drawn e^fc randojn from the same population, but who were not exposed 
to the*^innovation b^lng tested. Air variables, in both -samples 
would be controllecl. . * v ' ^ , 

In' most school situations, however, control ii not 'present. Students 

* "■ ' ' . : .V' '■ ■ 

'.are subject to ' innovative practices M^the basi,5 of need witho\^t 
concern for a research finding, thus eliminating the selection of 
a control group (e.g. , all underprivileged -children will benefit . 
from a federal project)^ Teachers' assignments aire often made .on 
the;basis of scheduling needs, not on the desire to test a hypothesis 
Control of' inputs (books, .supplies, etc.) are often dependent on 
operations outside o£ the school setting, such as a central adminis- 
trative' office; ^. 
Uncontrolled variables present in a given operational situation 
greatly hinder a researcher's ability to generalize from findings. 
This situation necessitates the development of an evaluation com- 
ponent which, rat^her than operate on the assumption of control, is 
designed to account for the lack of control. The model must^ set 
somewhere between the goal of describing an existing structure WhicfT 
is buried under a facade of-confusion and the goal of accovmting for 



V 



the lack of structured The model must be both a descriptive, tool by 
which to compare- alternative processes to accomplish similar ob- 
jectives and a manipulative tool by which needed future directions 
can be identified for ' decision making. As previously mentioned, the 
evaluation component *is a descriptive tool which does no\: "interfere 
with or manipulate project or program operations. The application 
of the model is to provide for a comparison of p:^ject processes as 
opposed to projects. 
Definition of Evaluation 

Evaluation is the assessment of performance by a tar^t population 
toward the attafnraent of specified objectives." It is comprised of 
those acts of designing and instrviment development, data collection 

- ^ 

and analysis, and report preparation^ 

I. Resultant Product — Decision Making^ Data Rq^ative To 
A. Feedback of findings and conclusions of program 
effectiveness. 

The equating of expenditures with a raeasur^ of the 
utility and/or effectiveness of a process or program 
for: . 

i: the identification of most* useful and/or 

effective processes for the least expenditure 
as they apply to diverse target populations; 
and ' > 

2. the determination of areas of program 'weaknesses* 



^ Identification of program thrusts most likely to 
meet specified program needs and a^ means of 
quantifying the impetus to thrust. ^ 



II • Overview 



The planning-evaJsuation design" recognizes aimitations from both the ^ 
£iscai and- evaluative "perspectives that are, placed. ^upon-the role , and, 
scope of planning and evaluatio;i^ in the public schools. The evalua- 
tion section 'of a planning-eyalii^tion model is composed of t^o com- 
■ponentsi forpiative evaluation conducted; at interim points of a 
program's duration and summatjAre__orLjina3^valua^^ 
would be Jonducted by,.5:?Dc£rpr6gram personnel with assistance _ from 
central a^JLni strive personnel. Methods of data collection would 
be si.milar to ^^^t now employed, with teacher-made tests and some ^ 
distrlct-wi-de testing instruments being the primary tools. ■ However, 
€he use of the data" would be far more reaching. 

Most evaluacion presently being conducted with'in and by a school 
is for the measurement of pupil achievement f^r the purpose of • 
evaluating the student not th^ educational, pr&griiT^ process con- 
tributing toward th^at achievement. "Most evaluation/results identify 
global areas' of rieed&',^but this is a residual not primary product. 



The proposed plahning-evaluation design, while not minimizing the 
need nor product of student' evaluation, will utilize these same 
results to better enable local teachers and administrators in alter- 
ing the programs and processes to increase student achievement toward 
the desired goals and objectives. 
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The sununative evaluatlontwould be a major source of information > 

for, the' program renewal phase ^f*a program and act ds a source 

of baseline., data with which to compare formative evaluation results/ 

Sununative evaluation would provide data 'in terms of'fhe" cost/ • " 

utility of a program and process.' The evaluation designs would 

be developed as the' programs are initially developed..and. would 

" ^ - ' .. • . * 

n^ces9arij.y vary from program to program.. Assessment would be . 

directed -toward measuij-ement of a process; contributioTn to students . 

in attaining the level of ^performance specified in an objective , ^ 

(achievement and attitudes). .. ■ 

A major component of summative evaluation would be data ^rom the"^ 
formative evaluation conducted regularly. This data would be reported 
periodically to -bi^ Department of Planning and Evaluation and pro-- 
vide a monitoring dbvice on a program for manaS^ement. . ' . . 

III. Evaluation Configuration 

A/ The development of the instructional ^py-ogram 
woAildNstart with the assessment of inc?ividual 
student needs and the statements 'of e?cpected 
achievement for each individual student through 
a uniform stratfture. These statemerits of 
^ expectation constitute spepific performance 

objectives for each indivual student. Ob- 
^' jectives for students provide the basis for, 
Stating the objectives for the classroom. 



; 'The objectives for the classroom provide 
the basis for determining the objectives 
for .the grade .level jjjd thin the school. 
The objectives for the grade level within . v 
^ the school define tTie objectives for' the ' , 
' ' grade level- across the city. These ob- ; 
jeotives, in turn, define the goals to\yard 
• which the entire school system is directed. 

B. The configuration for the evaluation, process- 
is identical to those of planning^^d program- 
ming. 

1. As the composite incremental objectives are, 
achieved, a supra-objective i-s attained. 

2. As a supra-objective is attained, the more 
^^broadly stated goals are attained. 

C. Evaluation, then, is based upon an approach where 
I the attainment of the parts leads to the attain- 
ment of the whole. 

Evaluation Procedure^ 

A. Formative Evaluation ^ 

1. Baseline data is collected during the 
previous summative evaluation. 
' 2. Instrument's are developed and administered 
by local , program persc5hnel. 



3* Results 'are compiled by local program 
personnel. , 

4. Resjilts are reported to the Department 
of Planning and Evaluation on, forms 
required by the particular design of the 

• summative evaluation^' 

5. -Evaluation is conducted "periodically" to: 
- (a) measiire student achievement for 

1 

grading purposes, and / • . |r 

(b) measure ^in^terim student . achieve- 

' . - ■■ ■ # 

.ment to determine effectiveness , 
of proces^^es and activities. 

6. Data in -normative reference? v.-ould be used to 
. alter program processes and Activities to 

increase "effectiveness toward student- 

achievement. 
Summative Evaluation 

1. The evaluation design and instruments would be 
.developed and administered under the direction 

of the Department of Planning and Evaluation. 

2. The data would be compiled and reported by 
the Department of Planning and Evaluation., - 

3. The findings and conclusions would be submitted 
to 'the Do.luth Public Schools management and 
program personnel for interpretation. 

* 

- 9 - 



1 • . , ' 

C.. Program Evalliation Analysis 

\ 1. The interpreters of 'evaluation data determine - 
\ where program^, may or may not have supceeded. 

12. Criterion of interpretation foi? evaluation data: 

I ■ ' ■ - ' 

' (a) Were th^ specified processes and 

activita^es carried out? 



\ 



(b) .Were th*e specified processes and\^- 
activities properly carried out? , 

t 

"(c) * Were the specified processes ^nd 
. \ ^activities incorrect for the 
tairget population?'.' 

(d) Have conditions changed, causing 
previouslfy stated processes and 
activities to fail? 

(e) Does a completely new need or 

problem exist which takes priority 

\ 

over the present program or project 

\' 

Goal Structure 



The model for the goal ^structure of a school system is an abstraction 
of the administrative structure. In mdst. iristaqces the structure is 
pyramidal in form but does not represent a hierarchy of needs. It 
represents levels at which different types of information are ap- 
propriate to educational decision making. The essence of the goal 

- 10 - ' 



structure model as it differs from the models presented in the litera- 
ture is that.ii starts with the identification of needs and statements 
of expectations for students at the b^pe' of the pyramid and from the 
identification of these individual student parameters al3, other 
objectives and goals are .defined. Based on the premise that the 
whole consists primarily of the sum of the parts, and that, assess- 
ment must begin with the smallest unit of analysis, the first sets 
of goals utilize expectations for the individual students. These 
expectations, stated in the form of specific performance objectives, 
represent the foundation on wh£ch rests the remainder . of the structure 

Definition of Objective s 

^In order to insure commonality of definition of types of objectives, 
several distinctions will- be notedi 'instructional objectives will 
be defined al behavioral objectives which specify a desired level of 
performance for a student or. a group of students. 

■3 

Example : 

During the thirty-minute ' "sharx*ng time" each 
morni-ngv Kim will make at least three voluntary^ 
.statements per period for five days. A voluntary 

statement. is one which is not prompted by a 

question from t^e teacher or anqther • student. 

Example : ' 
During the first semester of the 1972-73 school 
.-year the average number of skills mastered by 
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third grade students at P.S. 21 will be no less 
than four as measured on the Criterion Referenced 
^ests of the Wisconsin Reading Design. ^ : — 

The second level of a goal structure will consist of unit goals fcr 
individual schools stated in terms of management objectives for * 
teachers and administrators. The management objective is a. behavioral 
objective which specifies a desired level of performance for; a 
teacher and/or an administrator as related to the objectives for the 
classroom and the objectives for grade levels within the schools. 

Example : 

. ' The teacher will visit "the homeroom for each student 
at least once during the schdol year and will write 
a report on each visit, to be shared with the parents. - 
A tentative schedule for the home visits will be 
established by October 15, 1972. " 
When the management objective refers to the collective go^ls of the 
individual teachers and/or administrators within a school, they 
then constitute mission ob1ectives > 

Example : 

B:/ the end of the school year the home of each student 
enrolled in P.S. 21 will have been visited at least 
once by a teacher and/or admini'fetrator . ^ 
The management and mission objectives serve as quality control 
/ measures of task performance by the staff. 
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The third level of a goal structure is based on the identification 
of^rTstructional objectives, manageriient objectives, and mission 
objectives* At this level the objectives are stated to correlate 
with subject matter areas within the>tchools. They are identical 
in form to instructional objectives* They rely on the satisfaction 
of msnag^ment and mission objectives. Their particular characteristic ' 
is in' scope of coverage. 

Example ; 

By the end of the academic year all students enrolled 
^ in Advanced English at the Kennedy^ Junior High School' • 
will attain, a score on the Co-operative English Test 
equal, to or greater than 70 percentile* ^ * 

The final level of the goal structure, and the pinna'cle of the 
pyramid, refers^ to the reporting of objective attainment on a district- 
wide basis. The 'goal stateme nt is general in nature, does not change, 
drastically over , a long period, of time,^ and usually takes the form of 
a school ^V^tem^s aspirations and priorities; 

€ ^ 

Example : 

All '^students graduating from high schools in the 
school district will have -acquired adequate skills 
in the areas of Reading and Mathematics to parti- 
cipate in the general work force of the. country. 

The statements of objectives beyond the individual student and class- 
room levels are either predetermined by the student an'^d classroom' ob- 
jectives or are directly supportive to the attainment of student and 
classroom objectives. 
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Planning - Evaluation Model ^ 
Tasks-and Processes 

The combination of resource allocation, development and evalua/tion 
embodies a systematic a)pproach to supportive services for the admin- 
istration of instructional activities^ As viewed in one. schemata,, 
resource allocation is quantifidation of inputs in terms. of 

program design^ development i^ ^ quantification of administrative 

*• ' ' > » ^ • ' 

and instructional pro'desses in terras of human activities (inter- 
actions) and time constraints; evaluation^is a quantification of 
outputs in terms of changed human behavior £n accordance with a, 
predetermined £et of standards* (See Illustration A.) 



Illustration A 

Planning - Evaluation 
Model 



Inputs 



Resource 

Allocation 



Process 



Develo^isnt 



^ * Outputs 



Evaluation 



In terms of avctual implementation the schemata works in reverse. 
The involved <iepartments would first identify the desired outputs 
(identification of specific perfvOrmance objective based on needs 
- ."T.^o'smcni- ) . TVi(^. r.ccond tr^rk/" m-^v^ i c^'^<=i rt* . of i^,3nt"5 ^y* 

chose combinations of activities (sdi^ies .of tasks which consume 
human and material .resources witl}in predetermined time constraints) 
by which the objectives could be attaineci^ The definition of these ^ 
tasks and activities are the development ph^e of the planning process 
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Inpyts fpr the planning process are human and material resources . 
reduced to the common denominator cf<;^ dollar figure*. Thej iden- 
tification of inputs is defined as p'rogram^resourc6 allocation. It 
is differentiated from the task of budgeting and' accounting , in that 
it requires the detailed stQdy of program alternatives in an in- . 
structional context. Illustration B presents the functions of 
-departments relative to the sy;>tematic planning "^hemata presented 
in^ Illustration A. ... 

Illustration B 

Planning - Evalua1:ion 
Model 



Input 



Procesi 



Output 



n — 

Program 

Resource 

Allocation 



Identification 
and . 

Allocation 
of 

Available Resources 



Program 

Development 



Identification 
of 

Alternative 
Activities and 
Tasks 



Evaluation 



Definition 
of 

Performance 
Objectives 



The description of tasks presented in Illustration B represents the 
planning process as it is manifested prior to the initiation of the^ 
operation of the instructional program. During program operation a 
second phase of planni.ng takes place* This is program monitoring, 
and it is basically an interim accounting function by which 



Y 

(a) resources being consumed are compared to resources allocated, 

(b) tasks. being performed and activities being completed are com- 

pared to tasks and activities planned and time constraints imposed, 

and (c> the rate of objective attainment is compared to the end 

product standard as specified in the performance objectives. This 
« 

is^ ttie ,ity control phase of the planning function* ^ 

The third phase of the planning function takes place at that period 
of time which can logically be identified as a completion point of 
a program or a completion point of a major program componeriti " The 
completion r<^int is identified as the point Kin time when the per- 
formance objectives are expected to be attained. At this point: the 
determination is made as to v/hether the objectives have been reached, 
whether all tasks and activities were efficiently executed at an ^ 
acceptable level of quality, and whether resources were efficiently 
an^ effectively allocated to the tasks and activifciei. It is at this 
point that major decisions concerning the program are made and the 
entire planning process is again initiated -for future school system 
goals. Illustration C presents the completed picture of the proceg^s. 



/ 
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The primary responsibilities of Program Resource Allocation in 
terms of tasks are * . 

(A) Identification 

and 
Allocation 

■Of • ' ' 

Available 

Resources 

(B) Interim Measure 

of 

. Consumption 
to 

Allocation 

(C) Final Measure 

of 

Consumption 
to 

Allocation * 

In terms of processes the primary responsibility of Program Resource 
Allocation is coordination of Phase I, Initial Planning. 



/ 
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The primary responsibilities in terms of tasks for progranr Development 
are 

(A) Identification 

of Program 
Activities and 

Tasks 
(Constraints) 

(B) Interim Measure * . 

of 

Performance 
to Planned 
Constraints 

CC) Final MeasUre 
of 

Performance 

to * ~ \ 

Planned Constraiats 

In terms of processes the primary responsibility of Program Develop- 
ment is the coordination of Phase II, Monitoring. 



The primary responsibilities of Eva;Luation in terms pf tasks are 



(A) Definitions 

of 

Performance 
Objectives 

(B) Interim Measure 

of rate* of 
' Objective Attainnjent 

'(C) "Final Measure 

of ■ ' '' 



I 



Objective Attainment 



In terms of process the primary responsibility of Evaluation is the 
coordination of Phase III, Terminal Assessment. — . 



Planning - Evaluation Model ' 

' / 

An Example / 

Phase I: ' Initial Planning i- 

order to meet the needs of evaluation according to the procedures 
as outlihed in this" paper, a program description should include 
specific performance objectives reflecting the findings of the basic 
needs assessment. These objectives should refer to behavior changes 
for all participants receiving service. If changes are expected for 
teachers or parents under the list of intermediate goals (parent o^r 
/teacher behavior changes as an outcome of inservice ^ which is expected 
..-tt) relate to student behavior, changes) , these, too, should be stated 

^ * i 

in specific performance term's. 

Specific performance objectives for behavior changes should also be 
followed by a statement or statements describing the tasks which, 
when performed, will lead to the attainment of the objectives 
(management objectives). These tasks should be written so as to 
denote the specific consumption of human and material resources 
within a designated time period. Tasks should be described so that 
a manager can easily identify the point at which they begin, the 
point at which they terminate, and the outcomes that are dependent 
upon their completion. 



Identification of Need (Hypothetical) 
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In three high schools the attendance figifres are below 80%. Fifteen 
percent of thd student bpdy have been identified as chlfonic discipline 
problems, as evidenced by 9ne or more suspensions during the academic 
yeaa. The dropouu^rate in each of th^ schools during the junior and 
senior year is greater than 20%. ^ Over 25% of the student body in 
each of the SQhpols receive one or mor.^ failing grades during the 
academic year. Of the ^2o/ of the student body who should Jiave seen 
a counselor, 15% failed to do so* Through a survey of teachers, it 
was determined that 90% felt that they do not have the time to talk 
to the student with^these difficulties and that the students made no 
attempt to talk to tham. ^On the same svirvey the teachers indicated 
on the average that they thought that 20% of the students in their 
qlasses would not complete the ^academic year. 

Specific Performance Objectives 

'Based on the needs assessment, the teaching staff s of the schools 
identified the following specific performance objectives for students: 

I , • . ■ ' ' ' 

To reduce the number of potential dropouts as perceived 
'! ^ ( 

by the teachers ip each of the three schools to 10% of 

the total student body as recorded on a questionnaire 

tb be administered in January of the first year of 

ligroject operation. 

^ The number of failures of students identified as 
potential dropout's during the first year of project 
operation will, decrease by 50% as compared to the 
year before. . • 

- 22 



The actual number of cJrppouts recorded by June of 
the first year^of this pro j.ect' s operation will 
decreasfi by 50% as compared to the dropout rate 
of the year be^re as recorded in« the school 
records. - . 

For the students identified as potential dropouts, 
the number of days absent during the first year of 
this project's operation will .^ecrease by 50% as 
compared to the number of days absent during the 
previous' year (to be recorded in June of the first 
yecir of project operation). * \ ' 



At least 50% of the teachers who indicated that they 
seldom talked with students who were potential' drop- 
outs will indicate on a"" questionnaire to be admin- 
istered in^June o*f the first year of project 
operation that they have' talked at least once 
^ ' with each of the students who were -identified 
as potential dropouts. 

The number of suspensions obtained by students 
Identified as potential dropouts will be 50% less 
4 during the first year of this project's operation 
as compared to the preceding year. 
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On a questionnaire to be administered in June, at 
' least 80% of the potential dropouts who remain 
"in the school will indicate that: 

a/ Ther6 is at least one adult person 
in the school whom they like to 
talk to concerning their problems. 

B. That they enjoy going to school this 

year better than they did last year. ^ 

C That they hoped to complete their 
^:.high school education. 

^ 

D. That they have the ability to do 
well in school.* 

E. That they are no less able to perform 
well in school than are most of the 
other students. 

Tasks and Processes — Resource Allocation 

A handbook for working with students who are potential dropouts will 
be developed by project staff. The handbook will be ready by 
January 31 of the first year of project operation. The handbook 
will cost no more than $1,000.00 to publish. The handbook will 
require 200 hours or 4 working weeks of a project director's time 
($1,500'.00) , ten work sessions of three hours each with fifteen 
teachers from each school ($157.50 per teacher, $7,087.50 total) 



and thirty hours. of work time with the cj^unselors from each of the 
high schools ($150.50 per counselor, $47^.50 total). 

During the second semester of the. first project . year , counselors 
will visit eack classroom teacher three times for one hour each to 
discuss the .problems of specific students in each bf their classes. 
On the average, preparation and the visits require 360 hours of 
counselor time and 90 hours of teacher i:ime for each' school. The 
estimated cost is $4,500.00. 

Teachers will spend two hours each week talking with students identi- 
fied as potential dropouts. 'Estimated cost, $572.00 per teacher. 

Counselors will talk either by phone or in person at least once wxth 
the- parent or guardian of each potential dropout.* Estimated cost, 
$10.00 per student or -$3, 000. 00 per school. 

Phase II: .Monitoring . . ■ 

The work accomplished in the initial planning p)iase is perhaps the 
most difficult in that it requires the 'greatest amount of creativity 
and innovation. ■ The second phase, or monitoring phase, requires 
more technical than creati-ve type of output. The attempt of the 
planning group of the monitoring phase is to provide for quality 
control during the ongbing, operation* of the project. 
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Tasks and Processes — 
Resource AllQc^tion 

In the example proposal it. was stated that a handbook for working 
witb the students who are potential dropouts would be developed by 
tJ;ie' pro ject staff, by January 31 of the first project year of opera- 
tioh* It was also stated that i:he handbook would cost no more than 
* $1,0*00* It would be the responsibility of the planning .staff' to 
inform project personnel sometime prior to January 31 as to what 
the cost of ,the handbook woOld probably be and as to whether the 
handbook would be completed on time. Project staff would also have 
to be informed as' to whether the director, had exceeded the time 
allocation of 200 hours, or four working weeks* The same type of^ 
information would be communicated concerning the work of the fifteen 
participating teachers from each school and the counselors from each 
of the high schools within the stipulated tost and time allocation 
of those groups* 

During the second semester, of the first project year the planning 
staff would have the'^esponsibility of verifying that the counselors 
were visiting the classroom teachers under the" stipulated schedule 
and that they were discussing the problems of the students in 
accordance with the guidelines of the proposal. The planning staff 
would also verify that these activities were being conducted within 
the stipuj.ated time limits of 360 hours for counselors and 90 hours 
for teachers for each school. The last item of information com- 
municated to. the pro3ect staff would identify the degree of 
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discrepancy between the amount of money budgeted for these tasks ^ 
($4,500) and the 'amount actually being spent • 

During the second semester the planning staff would also verify 
that the participating teachers were spending two. hours each week 
talking with students identified as potential dropouts and would 
indicate to the project director whether these contacts we^-e 
being accomplished within the cosjb constraints of $572 per teacher. - 
The same verification process would be applied to the counselor's^ 
responsibility to talk with the parents or guardian qf each 
potential dropout at a cost no greater than $10 per student or 
$3,000 per school. - * - 

Specific Performance Obiectives 

, • • 

The planoing staff would inform' the project director as to whether 
the dropout rate in the three schools was being reduced sufficiently 
on. a mont'h-to-month basis for the terminal' objective of a 10% drop- 
out rate to be reached. 

The project director would be informed as to whether a 50% reduction 
of failures for. the potential dropouts could be achieved by the end 

K 

of the year. 

The project director would be informed as to whether the actual 
number of dcopout^j could possibly be reduced by 50% at the end of 
the year as compared to the year before. The project director would 
be informed as to whether absenteeism for dropouts could possibly 
be reduced by 50% as compared to the year before. 
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The project director wou^d be informed as to the number of teachers 
who could l^ndicate that they were cd)mmunicaeing more with the 
potential dropouts than they had the year before. 

The projett director would be informed as to whether suspensions , 
of potential dropouts would be reduced by 50% as compared to the * 
year before; 

Overview , , 

The project director would be given a series ^o-f recommendations 
for altering the program to counteract- discrepancies anticipated 
in achieving terminal objectives. ^ . ' 



Pha§e III: Terminal Assessment 



The project director and^ all other'school system administi?ators 
appropriately concerned .with ,the project would be informed as to 
whether each of the performance objectives had been attfained. The 
attainment of objectives would be presented in the 'context of the 
identified needs of the original proposal. Th'e discrepancy between 
expectations and accomplishment's would be noted and thfeir degree of 
.importance would be identifieH. 
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Example 



Tasks and Processes — 
Resource Allocation/ 



The project' director and all school administrators who ar^ ap- 
propriafcely con'cerned with the project woul4 be informed as to 
whether the* tasks of .the prvoject had been accomplished within the 
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specified 'tinie and resource constraints. The planr in^ stafi would 
also 'indicate to the administrators the degree of discrepancy- 
between time and resource consmption and the time and resource 
allocations* A |^idgment wuld be made as to whether these dis- 
crepancies would be overcome in future operations or whether they 
are sufficient to warrant termination of -the project.. 

The final conrounication of the planning staff to the administrators 
would be \;he relationship, between the costs of the project to its 
oVerali judgments of efficiency and effectiveness. If, for example, 
the per pupil cost per xounselor^ was successful in reducing the 
dropout rate* by 50% but cost S200 more per pupil than what had 
been planned, the project staff would recommend to' the adminis- 
trators a judgment as to whether ^that cost was necessaj-y, justifi- 
ably and still within the definition of an efficient program, 

i 



